Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

release/1.5.0: site updates part 1 (Orion, Hercules, Narwhal) #770

Conversation

climbfuji
Copy link
Collaborator

@climbfuji climbfuji commented Sep 11, 2023

Summary

  • Update .github/workflows/macos-ci-aarch64.yaml - write spack caches to different partition (via a symbolic link) to avoid disk space issues
  • Update site configs for Orion, Narwhal, Hercules: build spack python, update directory structure (3rd party dependencies, source cache), fix duplicate package problems
  • Update documentation for Orion, Narwhal, Hercules

Testing

Applications affected

All applications on these three systems using spack-stack-1.5.0

Systems affected

Orion, Narwhal, Hercules

Dependencies

Issue(s) addressed

Checklist

  • This PR addresses one issue/problem/enhancement, or has a very good reason for not doing so.
  • These changes have been tested on the affected systems and applications.
  • All dependency PRs/issues have been resolved and this PR can be merged.

climbfuji and others added 15 commits September 9, 2023 05:44
…-3.10.8-6pvtcn2/lib/python3.10/distutils/unixccompiler.py and envs/unified-env-gcc-10.3.0/install/gcc/10.3.0/python-3.10.8-6pvtcn2/lib/python3.10/distutils/unixccompiler.py.dom.test
…ion errors with [email protected] and later and to avoid segmentation faults with ufs-weather-model
@climbfuji climbfuji self-assigned this Sep 12, 2023
@climbfuji climbfuji added the INFRA JEDI Infrastructure label Sep 12, 2023
@climbfuji climbfuji marked this pull request as ready for review September 12, 2023 16:26
Comment on lines 26 to 28
py-pyyaml:
require:
- "@5.4.1"
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How critical is it for awscli to be the latest version? As I mentioned in my Slack message, I ran into the problem of conflicting awscli/py-pyyaml/py-botocore versions, and was able to resolve it by taking awscli and py-pyyaml back a version from the latest.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Based on the slack conversation we had, shall we merge this as is or should I change py-pyyaml to 5.4.1 and set awscli accordingly (which version is it), and remove the extra settings for Hercules/Orion?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If it works for all systems to set the versions in common/packages.yaml (py-pyyaml 5.4.1, awscli 1.27.84) then let's go ahead and do that.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done.

Copy link
Collaborator

@ulmononian ulmononian left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

might take some getting used to the new python set up (and require changes to the WM for orion for 1.5.0), but looks good.

Copy link
Collaborator

@AlexanderRichert-NOAA AlexanderRichert-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:)

@climbfuji climbfuji merged commit 1b2c22c into JCSDA:release/1.5.0 Sep 12, 2023
6 checks passed
@climbfuji climbfuji deleted the feature/release150_site_updates_part1_orion_hercules_narwhal branch September 12, 2023 19:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
INFRA JEDI Infrastructure
Projects
No open projects
Development

Successfully merging this pull request may close these issues.

4 participants